Parameters for each preprocessing step

Parameters for sc_trim_barcode

File paths

  • input fastq1: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.R2.fastq.gz
  • input fastq2: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.R1.fastq.gz
  • output fastq: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.combined.fastq.gz

Read structure

assume read1 contains the transcript

  • barcode in read1: NA
  • barcode in read2: start at position 6, length 7
  • UMI in read2: start at position 0, length 6

Read filter

  • remove reads that have N in its barcode or UMI: FALSE
  • remove reads with low quality: TRUE
    • minimum read quality: 20
    • maximum number of base below minimum read quality: 2

Parameters for alignment

  • input fastq: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.combined.fastq.gz
  • output bam file: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.combined.subread.bam
  • genome index: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/GRCm38.p6/GRCm38_with_ERCC

Parameters for sc_exon_mapping

  • input bam file: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.combined.subread.bam
  • output bam file: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.combined.exon.bam
  • transctiptome annotations: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/GRCm38.p6/gencode.vM18.primary_assembly.annotation.gff3, /stornext/Home/data/allstaff/h/hickey/.local/share/renv/cache/v5/R-3.6/x86_64-pc-linux-gnu/scPipe/1.8.0/96dbe230d12477825fb3768b2fa4c3a5/scPipe/extdata/ERCC92_anno.gff3
  • do strand specific mapping: TRUE
  • fix chromosome names: FALSE

Parameters for sc_demultiplex

  • input bam file: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.combined.exon.bam
  • output folder: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396
  • barcode annotation file: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.barcode_annotation.csv
  • maximum mismatch allowed in barcode: 1

Parameters for sc_gene_counting

  • output folder: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396
  • barcode annotation file: /stornext/General/data/user_managed/grpu_mritchie_1/hickey/SCORE/C075_Grant_Coultas/extdata/NN176/scPipe/LC396/LC396.barcode_annotation.csv
  • UMI correction: simple correction and merge UMI with distance 1
  • gene filtering: FALSE

Data summary

The organism is “mmusculus_gene_ensembl”, and gene id type is “ensembl_gene_id”.

Overall barcode statistics

if (is.null(params$organism) || is.na(params$organism)) {
  sce = create_sce_by_dir(params$outdir)
} else {
  sce = create_sce_by_dir(params$outdir, organism=params$organism, gene_id_type=params$gene_id_type)
}
overall_stat = demultiplex_info(sce)
datatable(overall_stat, width=800)

Plot barcode match statistics in pie chart:

plot_demultiplex(sce)

Read alignment statistics

ggplotly(plot_mapping(sce, dataname=params$samplename, percentage = FALSE))
ggplotly(plot_mapping(sce, dataname=params$samplename, percentage = TRUE))

Summary and distributions of QC metrics

if (any(colSums(counts(sce)) == 0)) {
  zero_cells = sum(colSums(counts(sce)) == 0)
  sce = sce[, colSums(counts(sce)) > 0]
} else {
  zero_cells = 0
}

Datatable of all QC metrics:

sce = calculate_QC_metrics(sce)
Warning: 'spikeNames' is deprecated.
See help("Deprecated")
Warning: 'isSpike' is deprecated.
See help("Deprecated")

Warning: 'isSpike' is deprecated.
See help("Deprecated")

Warning: 'isSpike' is deprecated.
See help("Deprecated")
Cache found
Cache found
if(!all(colSums(as.data.frame(QC_metrics(sce)))>0)){
  QC_metrics(sce) = QC_metrics(sce)[, colSums(as.data.frame(QC_metrics(sce)))>0]
}
datatable(as.data.frame(QC_metrics(sce)), width=800, options=list(scrollX= TRUE))

Summary of all QC metrics:

datatable(do.call(cbind, lapply(QC_metrics(sce), summary)), width=800, options=list(scrollX= TRUE))

Number of reads mapped to exon before UMI deduplication VS number of genes detected:

ggplotly(ggplot(as.data.frame(QC_metrics(sce)), aes(x=mapped_to_exon, y=number_of_genes))+geom_point(alpha=0.8))

knitr::knit_exit()
LS0tCnRpdGxlOiAic2NQaXBlIHJlcG9ydCBmb3Igc2FtcGxlIGByIHBhcmFtcyRzYW1wbGVuYW1lYCIKb3V0cHV0OgogIGh0bWxfbm90ZWJvb2s6CiAgICBjb2RlX2ZvbGRpbmc6IGhpZGUKICAgIHRvYzogdHJ1ZQogICAgdG9jX2Zsb2F0OiB0cnVlCiAgICBjb2xsYXBzZWQ6IGZhbHNlCnBhcmFtczoKICBzYW1wbGVuYW1lOiAiTEMzOTYiCiAgZnExOiAiL3N0b3JuZXh0L0dlbmVyYWwvZGF0YS91c2VyX21hbmFnZWQvZ3JwdV9tcml0Y2hpZV8xL2hpY2tleS9TQ09SRS9DMDc1X0dyYW50X0NvdWx0YXMvZXh0ZGF0YS9OTjE3Ni9zY1BpcGUvTEMzOTYvTEMzOTYuUjIuZmFzdHEuZ3oiCiAgZnEyOiAiL3N0b3JuZXh0L0dlbmVyYWwvZGF0YS91c2VyX21hbmFnZWQvZ3JwdV9tcml0Y2hpZV8xL2hpY2tleS9TQ09SRS9DMDc1X0dyYW50X0NvdWx0YXMvZXh0ZGF0YS9OTjE3Ni9zY1BpcGUvTEMzOTYvTEMzOTYuUjEuZmFzdHEuZ3oiCiAgZnFvdXQ6ICIvc3Rvcm5leHQvR2VuZXJhbC9kYXRhL3VzZXJfbWFuYWdlZC9ncnB1X21yaXRjaGllXzEvaGlja2V5L1NDT1JFL0MwNzVfR3JhbnRfQ291bHRhcy9leHRkYXRhL05OMTc2L3NjUGlwZS9MQzM5Ni9MQzM5Ni5jb21iaW5lZC5mYXN0cS5neiIKICBiYzFfaW5mbzogIk5BIgogIGJjMl9pbmZvOiAic3RhcnQgYXQgcG9zaXRpb24gNiwgbGVuZ3RoIDciCiAgdW1pX2luZm86ICJzdGFydCBhdCBwb3NpdGlvbiAwLCBsZW5ndGggNiIKICBybV9uOiBGQUxTRQogIHJtX2xvdzogVFJVRQogIG1pbl9xOiAyMAogIG51bV9icTogMgogIGJhbV9hbGlnbjogIi9zdG9ybmV4dC9HZW5lcmFsL2RhdGEvdXNlcl9tYW5hZ2VkL2dycHVfbXJpdGNoaWVfMS9oaWNrZXkvU0NPUkUvQzA3NV9HcmFudF9Db3VsdGFzL2V4dGRhdGEvTk4xNzYvc2NQaXBlL0xDMzk2L0xDMzk2LmNvbWJpbmVkLnN1YnJlYWQuYmFtIgogIGdfaW5kZXg6ICIvc3Rvcm5leHQvR2VuZXJhbC9kYXRhL3VzZXJfbWFuYWdlZC9ncnB1X21yaXRjaGllXzEvaGlja2V5L1NDT1JFL0MwNzVfR3JhbnRfQ291bHRhcy9leHRkYXRhL0dSQ20zOC5wNi9HUkNtMzhfd2l0aF9FUkNDIgogIGJhbV9tYXA6ICIvc3Rvcm5leHQvR2VuZXJhbC9kYXRhL3VzZXJfbWFuYWdlZC9ncnB1X21yaXRjaGllXzEvaGlja2V5L1NDT1JFL0MwNzVfR3JhbnRfQ291bHRhcy9leHRkYXRhL05OMTc2L3NjUGlwZS9MQzM5Ni9MQzM5Ni5jb21iaW5lZC5leG9uLmJhbSIKICBvdXRkaXI6ICIvc3Rvcm5leHQvR2VuZXJhbC9kYXRhL3VzZXJfbWFuYWdlZC9ncnB1X21yaXRjaGllXzEvaGlja2V5L1NDT1JFL0MwNzVfR3JhbnRfQ291bHRhcy9leHRkYXRhL05OMTc2L3NjUGlwZS9MQzM5NiIKICBhbm5vX2dmZjogIi9zdG9ybmV4dC9HZW5lcmFsL2RhdGEvdXNlcl9tYW5hZ2VkL2dycHVfbXJpdGNoaWVfMS9oaWNrZXkvU0NPUkUvQzA3NV9HcmFudF9Db3VsdGFzL2V4dGRhdGEvR1JDbTM4LnA2L2dlbmNvZGUudk0xOC5wcmltYXJ5X2Fzc2VtYmx5LmFubm90YXRpb24uZ2ZmMywgL3N0b3JuZXh0L0hvbWUvZGF0YS9hbGxzdGFmZi9oL2hpY2tleS8ubG9jYWwvc2hhcmUvcmVudi9jYWNoZS92NS9SLTMuNi94ODZfNjQtcGMtbGludXgtZ251L3NjUGlwZS8xLjguMC85NmRiZTIzMGQxMjQ3NzgyNWZiMzc2OGIyZmE0YzNhNS9zY1BpcGUvZXh0ZGF0YS9FUkNDOTJfYW5uby5nZmYzIgogIHN0bmQ6IFRSVUUKICBmaXhfY2hyOiBGQUxTRQogIGJjX2Fubm86ICIvc3Rvcm5leHQvR2VuZXJhbC9kYXRhL3VzZXJfbWFuYWdlZC9ncnB1X21yaXRjaGllXzEvaGlja2V5L1NDT1JFL0MwNzVfR3JhbnRfQ291bHRhcy9leHRkYXRhL05OMTc2L3NjUGlwZS9MQzM5Ni9MQzM5Ni5iYXJjb2RlX2Fubm90YXRpb24uY3N2IgogIG1heF9taXM6IDEKICBVTUlfY29yOiAic2ltcGxlIGNvcnJlY3Rpb24gYW5kIG1lcmdlIFVNSSB3aXRoIGRpc3RhbmNlIDEiCiAgZ2VuZV9mbDogRkFMU0UKICBvcmdhbmlzbTogIm1tdXNjdWx1c19nZW5lX2Vuc2VtYmwiCiAgZ2VuZV9pZF90eXBlOiAiZW5zZW1ibF9nZW5lX2lkIgoKLS0tCmBgYHtyLCB3YXJuaW5nPUZBTFNFLCBlY2hvPUZBTFNFLCBtZXNzYWdlPUZBTFNFfQpsaWJyYXJ5KHNjYWxlcykKbGlicmFyeShyZWFkcikKbGlicmFyeShnZ3Bsb3QyKQpsaWJyYXJ5KHBsb3RseSkKbGlicmFyeShEVCkKbGlicmFyeShzY2F0ZXIpCmxpYnJhcnkoc2NyYW4pCmxpYnJhcnkoc2NQaXBlKQpsaWJyYXJ5KFJ0c25lKQpgYGAKCiMgUGFyYW1ldGVycyBmb3IgZWFjaCBwcmVwcm9jZXNzaW5nIHN0ZXAKCiMjIFBhcmFtZXRlcnMgZm9yIGBzY190cmltX2JhcmNvZGVgCgojIyMgRmlsZSBwYXRocwoKKiBpbnB1dCBmYXN0cTE6IGByIHBhcmFtcyRmcTFgCiogaW5wdXQgZmFzdHEyOiBgciBwYXJhbXMkZnEyYAoqIG91dHB1dCBmYXN0cTogYHIgcGFyYW1zJGZxb3V0YAoKIyMjIFJlYWQgc3RydWN0dXJlCgphc3N1bWUgcmVhZDEgY29udGFpbnMgdGhlIHRyYW5zY3JpcHQKCiogYmFyY29kZSBpbiByZWFkMTogYHIgcGFyYW1zJGJjMV9pbmZvYAoqIGJhcmNvZGUgaW4gcmVhZDI6IGByIHBhcmFtcyRiYzJfaW5mb2AKKiBVTUkgaW4gcmVhZDI6IGByIHBhcmFtcyR1bWlfaW5mb2AKCiMjIyBSZWFkIGZpbHRlcgoKKiByZW1vdmUgcmVhZHMgdGhhdCBoYXZlIGBOYCBpbiBpdHMgYmFyY29kZSBvciBVTUk6IGByIHBhcmFtcyRybV9uYAoqIHJlbW92ZSByZWFkcyB3aXRoIGxvdyBxdWFsaXR5OiBgciBwYXJhbXMkcm1fbG93YApgciBpZiAocGFyYW1zJHJtX2xvdyl7cGFzdGUoIlx0KiBtaW5pbXVtIHJlYWQgcXVhbGl0eToiLCBwYXJhbXMkbWluX3EsICJcbiIsICJcdCogbWF4aW11bSBudW1iZXIgb2YgYmFzZSBiZWxvdyBtaW5pbXVtCnJlYWQgcXVhbGl0eToiLCBwYXJhbXMkbnVtX2JxLCAiXG4iKX1gCgojIyBQYXJhbWV0ZXJzIGZvciBhbGlnbm1lbnQKCiogaW5wdXQgZmFzdHE6IGByIHBhcmFtcyRmcW91dGAKKiBvdXRwdXQgYmFtIGZpbGU6IGByIHBhcmFtcyRiYW1fYWxpZ25gCiogZ2Vub21lIGluZGV4OiBgciBwYXJhbXMkZ19pbmRleGAKCiMjIFBhcmFtZXRlcnMgZm9yIGBzY19leG9uX21hcHBpbmdgCgoqIGlucHV0IGJhbSBmaWxlOiBgciBwYXJhbXMkYmFtX2FsaWduYAoqIG91dHB1dCBiYW0gZmlsZTogYHIgcGFyYW1zJGJhbV9tYXBgCiogdHJhbnNjdGlwdG9tZSBhbm5vdGF0aW9uczogYHIgcGFyYW1zJGFubm9fZ2ZmYAoqIGRvIHN0cmFuZCBzcGVjaWZpYyBtYXBwaW5nOiBgciBwYXJhbXMkc3RuZGAKKiBmaXggY2hyb21vc29tZSBuYW1lczogYHIgcGFyYW1zJGZpeF9jaHJgCgojIyBQYXJhbWV0ZXJzIGZvciBgc2NfZGVtdWx0aXBsZXhgCgoqIGlucHV0IGJhbSBmaWxlOiBgciBwYXJhbXMkYmFtX21hcGAKKiBvdXRwdXQgZm9sZGVyOiBgciBwYXJhbXMkb3V0ZGlyYAoqIGJhcmNvZGUgYW5ub3RhdGlvbiBmaWxlOiBgciBwYXJhbXMkYmNfYW5ub2AKKiBtYXhpbXVtIG1pc21hdGNoIGFsbG93ZWQgaW4gYmFyY29kZTogYHIgcGFyYW1zJG1heF9taXNgCgojIyBQYXJhbWV0ZXJzIGZvciBgc2NfZ2VuZV9jb3VudGluZ2AKCiogb3V0cHV0IGZvbGRlcjogYHIgcGFyYW1zJG91dGRpcmAKKiBiYXJjb2RlIGFubm90YXRpb24gZmlsZTogYHIgcGFyYW1zJGJjX2Fubm9gCiogVU1JIGNvcnJlY3Rpb246IGByIHBhcmFtcyRVTUlfY29yYAoqIGdlbmUgZmlsdGVyaW5nOiBgciBwYXJhbXMkZ2VuZV9mbGAKCiMgRGF0YSBzdW1tYXJ5CgpUaGUgb3JnYW5pc20gaXMgImByIHBhcmFtcyRvcmdhbmlzbWAiLCBhbmQgZ2VuZSBpZCB0eXBlIGlzICJgciBwYXJhbXMkZ2VuZV9pZF90eXBlYCIuCgojIyBPdmVyYWxsIGJhcmNvZGUgc3RhdGlzdGljcwoKYGBge3IsIHdhcm5pbmc9RkFMU0UsIG1lc3NhZ2U9RkFMU0V9CmlmIChpcy5udWxsKHBhcmFtcyRvcmdhbmlzbSkgfHwgaXMubmEocGFyYW1zJG9yZ2FuaXNtKSkgewogIHNjZSA9IGNyZWF0ZV9zY2VfYnlfZGlyKHBhcmFtcyRvdXRkaXIpCn0gZWxzZSB7CiAgc2NlID0gY3JlYXRlX3NjZV9ieV9kaXIocGFyYW1zJG91dGRpciwgb3JnYW5pc209cGFyYW1zJG9yZ2FuaXNtLCBnZW5lX2lkX3R5cGU9cGFyYW1zJGdlbmVfaWRfdHlwZSkKfQpvdmVyYWxsX3N0YXQgPSBkZW11bHRpcGxleF9pbmZvKHNjZSkKZGF0YXRhYmxlKG92ZXJhbGxfc3RhdCwgd2lkdGg9ODAwKQpgYGAKClBsb3QgYmFyY29kZSBtYXRjaCBzdGF0aXN0aWNzIGluIHBpZSBjaGFydDoKYGBge3J9CnBsb3RfZGVtdWx0aXBsZXgoc2NlKQpgYGAKCiMjIFJlYWQgYWxpZ25tZW50IHN0YXRpc3RpY3MKCmBgYHtyfQpnZ3Bsb3RseShwbG90X21hcHBpbmcoc2NlLCBkYXRhbmFtZT1wYXJhbXMkc2FtcGxlbmFtZSwgcGVyY2VudGFnZSA9IEZBTFNFKSkKYGBgCgpgYGB7cn0KZ2dwbG90bHkocGxvdF9tYXBwaW5nKHNjZSwgZGF0YW5hbWU9cGFyYW1zJHNhbXBsZW5hbWUsIHBlcmNlbnRhZ2UgPSBUUlVFKSkKYGBgCgojIyBTdW1tYXJ5IGFuZCBkaXN0cmlidXRpb25zIG9mIFFDIG1ldHJpY3MKCmBgYHtyfQppZiAoYW55KGNvbFN1bXMoY291bnRzKHNjZSkpID09IDApKSB7CiAgemVyb19jZWxscyA9IHN1bShjb2xTdW1zKGNvdW50cyhzY2UpKSA9PSAwKQogIHNjZSA9IHNjZVssIGNvbFN1bXMoY291bnRzKHNjZSkpID4gMF0KfSBlbHNlIHsKICB6ZXJvX2NlbGxzID0gMAp9CmBgYAoKYHIgaWYgKHplcm9fY2VsbHMgPiAwKXtwYXN0ZSh6ZXJvX2NlbGxzLCAiY2VsbHMgaGF2ZSB6ZXJvIHJlYWQgY291bnRzLCByZW1vdmUgdGhlbS4iKX1gCgpEYXRhdGFibGUgb2YgYWxsIFFDIG1ldHJpY3M6CmBgYHtyfQpzY2UgPSBjYWxjdWxhdGVfUUNfbWV0cmljcyhzY2UpCmlmKCFhbGwoY29sU3Vtcyhhcy5kYXRhLmZyYW1lKFFDX21ldHJpY3Moc2NlKSkpPjApKXsKICBRQ19tZXRyaWNzKHNjZSkgPSBRQ19tZXRyaWNzKHNjZSlbLCBjb2xTdW1zKGFzLmRhdGEuZnJhbWUoUUNfbWV0cmljcyhzY2UpKSk+MF0KfQpkYXRhdGFibGUoYXMuZGF0YS5mcmFtZShRQ19tZXRyaWNzKHNjZSkpLCB3aWR0aD04MDAsIG9wdGlvbnM9bGlzdChzY3JvbGxYPSBUUlVFKSkKYGBgCgpTdW1tYXJ5IG9mIGFsbCBRQyBtZXRyaWNzOgpgYGB7cn0KZGF0YXRhYmxlKGRvLmNhbGwoY2JpbmQsIGxhcHBseShRQ19tZXRyaWNzKHNjZSksIHN1bW1hcnkpKSwgd2lkdGg9ODAwLCBvcHRpb25zPWxpc3Qoc2Nyb2xsWD0gVFJVRSkpCmBgYAoKTnVtYmVyIG9mIHJlYWRzIG1hcHBlZCB0byBleG9uIGJlZm9yZSBVTUkgZGVkdXBsaWNhdGlvbiBWUyBudW1iZXIgb2YgZ2VuZXMgZGV0ZWN0ZWQ6CmBgYHtyfQpnZ3Bsb3RseShnZ3Bsb3QoYXMuZGF0YS5mcmFtZShRQ19tZXRyaWNzKHNjZSkpLCBhZXMoeD1tYXBwZWRfdG9fZXhvbiwgeT1udW1iZXJfb2ZfZ2VuZXMpKStnZW9tX3BvaW50KGFscGhhPTAuOCkpCmtuaXRyOjprbml0X2V4aXQoKQpgYGAKCiMgUXVhbGl0eSBjb250cm9sCgojIyBEZXRlY3Qgb3V0bGllciBjZWxscwoKQSByb2J1c3RpZmllZCBNYWhhbGFub2JpcyBEaXN0YW5jZSBpcyBjYWxjdWxhdGVkIGZvciBlYWNoIGNlbGwgdGhlbiBvdXRsaWVycyBhcmUgZGV0ZWN0ZWQgYmFzZWQgb24gdGhlIGRpc3RhbmNlLgpIb3dldmVyLCBkdWUgdG8gdGhlIGNvbXBsZXggbmF0dXJlIG9mIHNpbmdsZSBjZWxsIHRyYW5zY3JpcHRvbWVzIGFuZCBwcm90b2NvbCB1c2VkLCBzdWNoIGEgbWV0aG9kIGNhbiBvbmx5IGJlIHVzZWQgdG8KYXNzaXN0IHRoZSBxdWFsaXR5IGNvbnRyb2wgcHJvY2Vzcy4gVmlzdWFsIGluc3BlY3Rpb24gb2YgdGhlIHF1YWxpdHkgY29udHJvbCBtZXRyaWNzIGlzIHN0aWxsIHJlcXVpcmVkLiBCeSBkZWZhdWx0IHdlCnVzZSBgY29tcCA9IDJgIGFuZCB0aGUgYWxnb3JpdGhtIHdpbGwgdHJ5IHRvIHNlcGFyYXRlIHRoZSBxdWFsaXR5IGNvbnRyb2wgbWV0cmljcyBpbnRvIHR3byBnYXVzc2lhbiBjbHVzdGVycy4KClRoZSBudW1iZXIgb2Ygb3V0bGllcnM6CmBgYHtyfQpzY2VfcWMgPSBkZXRlY3Rfb3V0bGllcihzY2UsIHR5cGU9ImxvdyIsIGNvbXAgPSAyKQp0YWJsZShRQ19tZXRyaWNzKHNjZV9xYykkb3V0bGllcnMpCmBgYAoKUGFpcndpc2UgcGxvdCBmb3IgUUMgbWV0cmljcywgY29sb3JlZCBieSBvdXRsaWVyczoKYGBge3IsIHdhcm5pbmc9RkFMU0UsIG1lc3NhZ2U9RkFMU0V9CnBsb3RfUUNfcGFpcnMoc2NlX3FjKQpgYGAKCiMjIHBsb3QgaGlnaGVzdCBleHByZXNzaW9uIGdlbmVzCgpSZW1vdmUgbG93IHF1YWxpdHkgY2VsbHMgYW5kIHBsb3QgaGlnaGVzdCBleHByZXNzaW9uIGdlbmVzLgoKYGBge3J9CnNjZV9xYyA9IHJlbW92ZV9vdXRsaWVycyhzY2VfcWMpCnNjZV9xYyA9IGNvbnZlcnRfZ2VuZWlkKHNjZV9xYywgcmV0dXJucz0iZXh0ZXJuYWxfZ2VuZV9uYW1lIikKc2NlX3FjIDwtIGNhbGN1bGF0ZVFDTWV0cmljcyhzY2VfcWMpCnBsb3RRQyhzY2VfcWMsIHR5cGUgPSAiaGlnaGVzdC1leHByZXNzaW9uIiwgbj0yMCkKYGBgCgojIyByZW1vdmUgbG93IGFidW5kYW50IGdlbmVzCgpQbG90IHRoZSBhdmVyYWdlIGNvdW50IGZvciBlYWNoIGdlbmVzOgpgYGB7cn0KYXZlLmNvdW50cyA8LSByb3dNZWFucyhjb3VudHMoc2NlX3FjKSkKaGlzdChsb2cxMChhdmUuY291bnRzKSwgYnJlYWtzPTEwMCwgbWFpbj0iIiwgY29sPSJncmV5ODAiLAogICAgIHhsYWI9ZXhwcmVzc2lvbihMb2dbMTBdfiJhdmVyYWdlIGNvdW50IikpCmBgYAoKQXMgYSBsb29zZSBmaWx0ZXIgd2Uga2VlcCBnZW5lcyB0aGF0IGFyZSBleHByZXNzZWQgaW4gYXQgbGVhc3QgdHdvIGNlbGxzIGFuZCBmb3IgY2VsbHMgdGhhdCBleHByZXNzIHRoYXQgZ2VuZSwgdGhlCmF2ZXJhZ2UgY291bnQgbGFyZ2VyIHRoYW4gdHdvLiBIb3dldmVyIHRoaXMgaXMgbm90IHRoZSBnb2xkIHN0YW5kYXJkIGFuZCB0aGUgZmlsdGVyIG1heSB2YXJpeSBkZXBlbmRpbmcgb24gdGhlIGRhdGEuCgpgYGB7cn0Ka2VlcDEgPSAoYXBwbHkoY291bnRzKHNjZV9xYyksIDEsIGZ1bmN0aW9uKHgpIG1lYW4oeFt4PjBdKSkgPiAxLjEpICAjIGF2ZXJhZ2UgY291bnQgbGFyZ2VyIHRoYW4gMS4xCmtlZXAyID0gKHJvd1N1bXMoY291bnRzKHNjZV9xYyk+MCkgPiA1KSAgIyBleHByZXNzZWQgaW4gYXQgbGVhc3QgNSBjZWxscwoKc2NlX3FjID0gc2NlX3FjWyhrZWVwMSAmIGtlZXAyKSwgXQpkaW0oc2NlX3FjKQpgYGAKCldlIGdvdCBgciBucm93KHNjZV9xYylgIGdlbmVzIGxlZnQgYWZ0ZXIgcmVtb3ZpbmcgbG93IGFidW5kYW50IGdlbmVzLgoKIyBEYXRhIG5vcm1hbGl6YXRpb24KCiMjIE5vcm1hbGl6YXRpb24gYnkgYHNjcmFuYCBhbmQgYHNjYXRlcmAKCkNvbXB1dGUgdGhlIG5vcm1hbGl6YXRpb24gc2l6ZSBmYWN0b3IKCmBgYHtyfQpuY2VsbHMgPSBuY29sKHNjZV9xYykKaWYgKG5jZWxscyA+IDIwMCkgewogIHNjZV9xYyA8LSBjb21wdXRlU3VtRmFjdG9ycyhzY2VfcWMpCn0gZWxzZSB7CiAgc2NlX3FjIDwtIGNvbXB1dGVTdW1GYWN0b3JzKHNjZV9xYywgc2l6ZXM9YXMuaW50ZWdlcihjKG5jZWxscy83LCBuY2VsbHMvNiwgbmNlbGxzLzUsIG5jZWxscy80LCBuY2VsbHMvMykpKQp9CnN1bW1hcnkoc2l6ZUZhY3RvcnMoc2NlX3FjKSkKYGBgCgpgciBpZiAobWluKHNpemVGYWN0b3JzKHNjZV9xYykpIDw9IDApe3Bhc3RlKCJXZSBoYXZlIG5lZ2F0aXZlIHNpemUgZmFjdG9ycyBpbiB0aGUgZGF0YS4gVGhleSBpbmRpY2F0ZSBsb3cgcXVhbGl0eSBjZWxscwphbmQgd2UgaGF2ZSByZW1vdmVkIHRoZW0uIFRvIGF2b2lkIG5lZ2F0aXZlIHNpemUgZmFjdG9ycywgdGhlIGJlc3Qgc29sdXRpb24gaXMgdG8gaW5jcmVhc2UgdGhlIHN0cmluZ2VuY3kgb2YgdGhlCmZpbHRlcmluZy4iKX1gCgpgYGB7cn0KaWYgKG1pbihzaXplRmFjdG9ycyhzY2VfcWMpKSA8PSAwKSB7CiAgc2NlX3FjID0gc2NlX3FjWywgc2l6ZUZhY3RvcnMoc2NlX3FjKT4wXQp9CmBgYAoKUENBIHBsb3QgdXNpbmcgZ2VuZSBleHByZXNzaW9ucyBhcyBpbnB1dCwgY29sb3JlZCBieSB0aGUgbnVtYmVyIG9mIGdlbmVzLgoKYGBge3J9CmNwbShzY2VfcWMpID0gY2FsY3VsYXRlQ1BNKHNjZV9xYywgdXNlX3NpemVfZmFjdG9ycz1GQUxTRSkKcGxvdFBDQShzY2VfcWMsIHJ1bl9hcmdzID0gbGlzdChleHByc192YWx1ZXM9ImNwbSIpLCBjb2xvdXJfYnk9InRvdGFsX2ZlYXR1cmVzIikKYGBgCgojIyMgTm9ybWFsaXplIHRoZSBkYXRhIHVzaW5nIHNpemUgZmFjdG9yIGFuZCBnZXQgaGlnaCB2YXJpYWJsZSBnZW5lcwoKVGhlIGhpZ2hseSB2YXJpYWJsZSBnZW5lcyBhcmUgY2hvc2VuIGJhc2VkIG9uIGB0cmVuZFZhcmAgZnJvbSBgc2NyYW5gIHdpdGggYEZEUiA+IDAuMDVgIGFuZCBiaW9sb2dpY2FsIHZhcmlhdGlvbiBsYXJnZXIKdGhhbiBgMC41YC4gSWYgdGhlIG51bWJlciBvZiBoaWdobHkgdmFyaWFibGUgZ2VuZXMgaXMgc21hbGxlciB0aGFuIDEwMCB3ZSB3aWxsIHNlbGVjdCB0aGUgdG9wIDEwMCBnZW5lcyBieSBiaW9sb2dpY2FsCnZhcmlhdGlvbi4gSWYgdGhlIG51bWJlciBpcyBsYXJnZXIgdGhhbiA1MDAgd2Ugd2lsbCBvbmx5IGtlZXAgdG9wIDUwMCBnZW5lcyBieSBiaW9sb2dpY2FsIHZhcmlhdGlvbi4KCmBgYHtyLCB3YXJuaW5nPUZBTFNFLCBtZXNzYWdlPUZBTFNFfQpzY2VfcWMgPC0gbm9ybWFsaXplKHNjZV9xYykKCnZhci5maXQgPC0gdHJlbmRWYXIoc2NlX3FjLCBtZXRob2Q9ImxvZXNzIiwgdXNlLnNwaWtlcz1GQUxTRSkKdmFyLm91dCA8LSBkZWNvbXBvc2VWYXIoc2NlX3FjLCB2YXIuZml0KQoKaWYgKGxlbmd0aCh3aGljaCh2YXIub3V0JEZEUiA8PSAwLjA1ICYgdmFyLm91dCRiaW8gPj0gMC41KSkgPCA1MDApewogIGh2Zy5vdXQgPC0gdmFyLm91dFtvcmRlcih2YXIub3V0JGJpbywgZGVjcmVhc2luZz1UUlVFKVsxOjUwMF0sIF0KfWVsc2UgaWYobGVuZ3RoKHdoaWNoKHZhci5vdXQkRkRSIDw9IDAuMDUgJiB2YXIub3V0JGJpbyA+PSAwLjUpKSA+IDEwMDApewogIGh2Zy5vdXQgPC0gdmFyLm91dFtvcmRlcih2YXIub3V0JGJpbywgZGVjcmVhc2luZz1UUlVFKVsxOjEwMDBdLCBdCn1lbHNlewogIGh2Zy5vdXQgPC0gdmFyLm91dFt3aGljaCh2YXIub3V0JEZEUiA8PSAwLjA1ICYgdmFyLm91dCRiaW8gPj0gMC41KSwgXQogIGh2Zy5vdXQgPC0gaHZnLm91dFtvcmRlcihodmcub3V0JGJpbywgZGVjcmVhc2luZz1UUlVFKSwgXQp9CgpwbG90KHZhci5vdXQkbWVhbiwgdmFyLm91dCR0b3RhbCwgcGNoPTE2LCBjZXg9MC42LCB4bGFiPSJNZWFuIGxvZy1leHByZXNzaW9uIiwKICAgICB5bGFiPSJWYXJpYW5jZSBvZiBsb2ctZXhwcmVzc2lvbiIpCm8gPC0gb3JkZXIodmFyLm91dCRtZWFuKQpsaW5lcyh2YXIub3V0JG1lYW5bb10sIHZhci5vdXQkdGVjaFtvXSwgY29sPSJkb2RnZXJibHVlIiwgbHdkPTIpCnBvaW50cyh2YXIub3V0JG1lYW5bcm93bmFtZXModmFyLm91dCkgJWluJSByb3duYW1lcyhodmcub3V0KV0sIHZhci5vdXQkdG90YWxbcm93bmFtZXModmFyLm91dCkgJWluJSByb3duYW1lcyhodmcub3V0KV0sIGNvbD0icmVkIiwgcGNoPTE2KQpgYGAKCiMjIEhlYXRtYXAgb2YgdG9wMTAwIGhpZ2ggdmFyaWFibGUgZ2VuZXMKCmBgYHtyfQpnZW5lX2V4cCA9IGV4cHJzKHNjZV9xYykKCmdlbmVfZXhwID0gZ2VuZV9leHBbcm93bmFtZXMoaHZnLm91dClbMToxMDBdLCBdCgpoYy5yb3dzIDwtIGhjbHVzdChkaXN0KGdlbmVfZXhwKSkKaGMuY29scyA8LSBoY2x1c3QoZGlzdCh0KGdlbmVfZXhwKSkpCgpnZW5lX2V4cCA9IGdlbmVfZXhwW2hjLnJvd3Mkb3JkZXIsIGhjLmNvbHMkb3JkZXJdCgptID0gbGlzdCgKICBsID0gMTAwLAogIHIgPSA0MCwKICBiID0gMTAsCiAgdCA9IDEwLAogIHBhZCA9IDAKKQoKcGxvdF9seSgKICAgIHggPSBjb2xuYW1lcyhnZW5lX2V4cCksIHkgPSByb3duYW1lcyhnZW5lX2V4cCksCiAgICB6ID0gZ2VuZV9leHAsIHR5cGUgPSAiaGVhdG1hcCIpJT4lCmxheW91dChhdXRvc2l6ZSA9IEYsIG1hcmdpbiA9IG0pCmBgYAoKIyBEaW1lbnNpb25hbGl0eSByZWR1Y3Rpb24gdXNpbmcgaGlnaCB2YXJpYWJsZSBnZW5lcwoKIyMgRGltZW5zaW9uYWxpdHkgcmVkdWN0aW9uIGJ5IFBDQQoKYGBge3J9CnBsb3RQQ0Eoc2NlX3FjLCBydW5fYXJncyA9IGxpc3QoZXhwcnNfdmFsdWVzPSJsb2djb3VudHMiKSwgY29sb3VyX2J5PSJ0b3RhbF9mZWF0dXJlcyIpCmBgYAoKIyMgRGltZW5zaW9uYWxpdHkgcmVkdWN0aW9uIGJ5IHQtU05FCgpgYGB7ciwgZmlnLndpZHRoPTEwLCBmaWcuaGVpZ2h0PTMuNX0Kc2V0LnNlZWQoMTAwKQppZiAoYW55KGR1cGxpY2F0ZWQodChsb2djb3VudHMoc2NlX3FjKVtyb3duYW1lcyhodmcub3V0KSwgXSkpKSkgewogIHNjZV9xYyA9IHNjZV9xY1ssICFkdXBsaWNhdGVkKHQobG9nY291bnRzKHNjZV9xYylbcm93bmFtZXMoaHZnLm91dCksIF0pKV0KfQpvdXQ1IDwtIHBsb3RUU05FKHNjZV9xYywgcnVuX2FyZ3MgPSBsaXN0KGV4cHJzX3ZhbHVlcz0ibG9nY291bnRzIiwgcGVycGxleGl0eT0xMCxmZWF0dXJlX3NldD1yb3duYW1lcyhodmcub3V0KSksIGNvbG91cl9ieT0idG90YWxfZmVhdHVyZXMiKSArIGdndGl0bGUoIlBlcnBsZXhpdHkgPSAxMCIpCm91dDEwIDwtIHBsb3RUU05FKHNjZV9xYywgcnVuX2FyZ3MgPSBsaXN0KGV4cHJzX3ZhbHVlcz0ibG9nY291bnRzIiwgcGVycGxleGl0eT0yMCxmZWF0dXJlX3NldD1yb3duYW1lcyhodmcub3V0KSksIGNvbG91cl9ieT0idG90YWxfZmVhdHVyZXMiLAogICAgIGZlYXR1cmVfc2V0PXJvd25hbWVzKGh2Zy5vdXQpKSAgKyBnZ3RpdGxlKCJQZXJwbGV4aXR5ID0gMjAiKQpvdXQyMCA8LSBwbG90VFNORShzY2VfcWMsIHJ1bl9hcmdzID0gbGlzdChleHByc192YWx1ZXM9ImxvZ2NvdW50cyIsIHBlcnBsZXhpdHk9MzAsZmVhdHVyZV9zZXQ9cm93bmFtZXMoaHZnLm91dCkpLCBjb2xvdXJfYnk9InRvdGFsX2ZlYXR1cmVzIiwKICAgICBmZWF0dXJlX3NldD1yb3duYW1lcyhodmcub3V0KSkgICsgZ2d0aXRsZSgiUGVycGxleGl0eSA9IDMwIikKbXVsdGlwbG90KG91dDUsIG91dDEwLCBvdXQyMCwgY29scz0zKQpgYGAK